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Abstract 



The Held-Karp heuristic for the Traveling Salesman Problem (TSP) has in prac- 
tice provided near-optimal lower bounds on the cost of solutions to the TSP. We 
analyze the structure of Held-Karp solutions in order to shed light on their quality. 
In the symmetric case with triangle inequality, we show that a class of instances has 
planar solutions. We also show that Held-Karp solutions have a certain monotonicity 
property. This leads to an alternate proof of a result of Wolsey, which shows that 
the value of Held-Karp heuristic is always at least |C?7>T, where OVT is the cost 
of the optimum TSP tour. Additionally, we show that the value of the Held-Karp 
heuristic is equal to that of the linear relaxation of the biconnected-graph problem 
when edge costs are non-negative. 

In the asymmetric case with triangle inequality, we show that there are many 
equivalent definitions of the Held-Karp heuristic, which include finding optimally 
weighted 1-arborescences, 1-antiarborescences, asymmetric 1-trees, and assignment 
problems. We prove that monotonicity holds in the asymmetric case as well. These 
theorems imply that the value of the Held-Karp heuristic is no less than -r^-^OVT 
and no less than the value of the Balas-Christofides heuristic for the asymmetric 
TSP. 

For the 1,2-TSP, we show that the Held-Karp heuristic cannot do any better than 
■^OVT, even as the number of nodes tends to infinity. 
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Chapter 1 

Introduction 

1.1 General Background 

The Traveling Salesman Problem (TSP) is one of the most notorious in the field of 
combinatorial optimization, and one of the most well-studied [24]. As with many 
other famous open questions in mathematics, such as Fermat's Last Theorem, the 
question is quite easy to state, but its solution has evaded researchers. The problem 
is this: given the costs associated with traveling between any pair of n cities, find 
the least-cost tour that visits each city exactly once. In other words, suppose we 
have costs c,j, 1 < i,j < n, associated with traveling from city i to city j. To solve 
a particular instance of the problem (that is, to solve the problem for a particular n 
and a particular set of Cij), we must find a cyclic permutation a n such that 

n n 

i = l 8 = 1 

The open question posed by the Traveling Salesman Problem differs from that 
posed by Fermat's Last Theorem, however, in that it involves determining the exis- 
tence of an algorithm for the TSP whose running time is bounded by a polynomial 
in n. A polynomial-time algorithm for the TSP would be able to determine a n for all 
possible instances. Proving the existence of such an algorithm (either constructively 
or non-constructively) would be similar to proving that a decision version of the TSP 
is in V, the class of all polynomial-time solvable decision problems. The decision ver- 
sion of the TSP includes an extra number B in the input and outputs "yes" if and 
only if the cost of the minimum tour is no greater than B. If a polynomial-time algo- 

13 



14 CHAPTER 1. INTRODUCTION 

rithm for the TSP exists, then certainly a polynomial- time algorithm for the decision 
version of the TSP exists. It is also not too hard to see that the converse is true (see 
[20], pp. 46-48). Thus a polynomial- time algorithm for the TSP exists if and only 
if the TSP decision problem is in V. This does not seem very likely, however, since 
the TSP decision problem is ./VP-complete [22]. A^P-completeness implies that if the 
TSP decision problem is in V, then V = AfV. Whether or not V = MV is unknown, 
but it is generally believed that V ^ AfV. 

Nevertheless, work has continued on the TSP through attempts to find polynomial- 
time approximation algorithms [21]. The most natural way to approximate the TSP 
is to devise an algorithm that explicitly constructs a tour which is not necessarily 
the minimum-cost tour. Such an algorithm may have a guarantee that the tour it 
constructs has cost no greater than a times the cost of the optimum tour (OVT), for 
some a > 1. Another way to approximate the TSP is to find a value that estimates 
the cost of the optimal tour. There are several ways to find such a value. One way 
is to construct an optimal relaxed tour. If we think of a tour as a combinatorial 
object with certain properties (e.g., a graph with n edges, connected, each node with 
degree two, and so on), then a relaxed tour is a combinatorial object with a subset of 
those properties, so that all tours are also relaxed tours. For example, an assignment 
is a relaxed tour since it is a graph with n edges such that each node has degree 
two. Clearly a minimum-cost relaxed tour can have cost no greater than OVT. A 
relaxed-tour approximation algorithm may also have a guarantee that the value it 
produces is no less than 7 times OVT, 7 < 1. Thus by finding optimal relaxed tours 
in polynomial time, we can approximate the value of the optimal tour without explic- 
itly constructing a tour. We will call an approximation algorithm non- constructive 
if it does not construct a tour in its approximation of OVT. From here on, we will 
say that an approximation algorithm has a guarantee of a if a > 1 and the value it 
returns is between OVT and ctOVT, and that it has a guarantee of 7 if 7 < 1 and the 
value it returns is between fOVT and OVT. We can transform an a approximation 
algorithm into a 7 = ^ approximation algorithm simply by multiplying the value of 
the a algorithm by ^. Therefore, an a approximation algorithm will be said to be 
"as good as" a 7 = — approximation algorithm. 

Unfortunately, Sahni & Gonzalez [32] have shown that no TSP approximation 



1.2. THE HELD-KARP HEURISTIC 15 

algorithms exist with constant guarantees unless V = NV. Thus research in ap- 
proximation algorithms for the TSP has concentrated on several special cases of the 
TSP, each of which is A^-complete in its own right. These special cases include 
the symmetric TSP with triangle inequality, the asymmetric TSP with triangle in- 
equality, and the symmetric 1,2-TSP. A TSP instance is said to be symmetric if 
c,-j = Cji for all i,j, and asymmetric if this is not necessarily the case. An instance 
obeys the triangle inequality if Cij < cu, + c^j for all distinct i,j,k, and an instance 
is a case of the 1,2-TSP if for all i,j either c,-j = 1 or c,-j = 2. The best known 
tour- constructing approximation algorithms for these three cases have guarantees of 
a = | [3], a — [logn] [11], and a = | [30] respectively. Not as much work has 
been done on finding non-constructive approximation algorithms with good guaran- 
tees. Nevetheless, in the symmetric case with triangle inequality, it is well known 
that finding a minimum-cost spanning tree gives an 7 = ^ guarantee. In addition, 
several non-constructive heuristics seem to do very well in practice [17], [1], [2]. In 
particular, a "lower bound" heuristic developed by Held and Karp typically delivers 
solutions of cost above 99% of OVT for the symmetric case with triangle inequality 
[4], [37]. 

1.2 The Held-Karp Heuristic 

Held and Karp proposed trying to find a minimum-cost tour in the symmetric case 
by trying to find an optimally weighted 1-tree [17]. A 1-tree of a graph G — (V,E) 
with V — {1, . . . , n} is a spanning tree on nodes {2, . . . , n] plus two edges incident 
to node 1. Thus a 1-tree has exactly one cycle, which contains node 1, and node 1 
always has degree two. Note that a 1-tree is a relaxed tour. A minimum-cost 1-tree 
can be obtained by finding a minimum-cost spanning tree on {2, ... ,n} and adding 
the two lowest cost edges incident to node 1. If n = (7i"i, . . . , 7r„) is a real n-vector, 
then the minimum-cost 1-tree with respect to -k is defined to be the minimum-cost 
1-tree with respect to the reduced costs c,j — c,-j + 7T; + ttj. If T^ is the minimum-cost 
1-tree with respect to rr, we define w(ir) such that 

n 
(i,J)€T k i=l 
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The value produced by the Held-Karp heuristic is max 7r w(7r). In other words, the 
Held-Karp heuristic finds the vector it such that the value of the minimum- cost 1-tree 
is the greatest. 

Intuitively, the heuristic tries to find the ir vector such that the 1-tree is as close 
as possible to being a tour, without exceeding the cost of the optimal tour. Suppose 
that the minimum-cost 1-tree with respect to it has a node u with degree greater 
than 2. Then it seems that we should be able to find a it' such that w(ir') > w(t) 
simply by increasing the value of ir u , since this will increase the J2(i,j)eT k ^ij P ar ^ °f 
w(tt) by more than the — 2 5Z?=i ^t P art W1 ^ decrease. Likewise, if u has degree 1, 
then we should be able to find a a ■k' such that w(-k') > w(-k) by decreasing the value 
of 7r u . Thus by finding max T w(ir), the heuristic tries to force the degree of all nodes 
to be 2. Now suppose T t is the minimum-cost tour. Then 



(i,j)er k i=\ 

n 

(i,j)€T t ."=1 

n 

= J2 (c ij + Tr i + Tr J )-2j2^i 
(«',J)GT t «"=1 

= J2 Ci i- 
(»"0')6Tt 



So certainly max T w(it) is no greater than the cost of the optimal tour, J2(i,j)eT t c ij- 
Held and Karp proved the following theorem about their heuristic. 



Theorem 1.2.1 (Held, Karp [17]) The Held-Karp heuristic produces exactly the 
same value as the following linear program 1 : 



In fact, Held and Karp consider a linear program with the subtour elimination constraints (that 
is, constraints ^ x t] < \ S | — 1 ) only for those subsets not containing node 1 . However, it is easy to see 
that the additional constraints are implied by the corresponding constraint on the complementary 
set of nodes. 
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minimize TJ CijXij (1-1) 

l<i<Cj<n 



L, i., . . . , .<,, 



subject to: Y^ z,j + Y^ ij,- = 2, i=l,2, 

2J ^ij ^ l^l — 1' / or an y proper subset S C V , 

i£S,j£S,i<j 

X{j < 1 1 < 2 ; < j < n, 

Xij > 1 < i < j < n. 

This linear program produces a relaxed tour, where variable Xij denotes the 
amount of edge (i,j) in the solution. Note that if the X{j variables were guaranteed 
to be either or 1, the relaxed tour would be an actual tour, and the linear program 
would solve the TSP exactly. Linear program (1.1) is sometimes called the linear 
relaxation of the TSP. 2 We will refer to (1.1) as the Subtour LP. 

The formulation of the heuristic as a search for an optimally weighted 1-tree can 
be thought of as an instance of Lagrangean relaxation. In Lagrangean relaxation, 
some constraints of a linear program are dropped, but penalties for their violation 
are added to the objective function. In the case of the Subtour LP, the constraints 
forcing the degree of each node to be 2 are dropped but the ir vector acts as a penalty 
for violating the node degree constraints. The 7T; are sometimes called Lagrangean 
multipliers. 

There are other equivalent formulations of the Held-Karp heuristic. In their 
original paper, Held and Karp noted that max T w(ir) can be expressed as a linear 
program. Let Ti,T 2 , . . . ,T t be an enumeration of all 1-trees. It will be convenient to 
let Cfc be the cost of 1-tree Tk, d^ be the degree of node i in T^, and v^ — d^ — 2. 
So then 

n 

w(tt) = minfcfc + V 7r,-v t - fc ]. 



Thus we can express max,,- w(7r) as 

2 Interestingly enough, (1.1) was the basis of one of the earliest attempts to grapple with the TSP. 
Dantzig, Fulkerson, and Johnson [5] started with the node degree constraints ^ Xij = 2 and added 
subtour elimination constraints as necessary. 
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maximize w , . 

subject to: w < Ck + Y2=i XiVik, V& = 1, . . . , t. 

The dual of this linear program will also be an equivalent formulation of the heuristic. 
Taking the dual of (1.2) yields 

minimize J2k c kVk 

subject to: J2kVk = 1, ^ ^ 

J2k v ikVk = i = l,...,n, 

Vk > o. 
Held and Karp noted that the LP above finds the minimum-cost convex combination 
of 1-trees such that the average degree of each node is 2. Finally, it has been shown 
that the subtour elimination constraints of the Subtour LP can be replaced with 
constraints of the form 3 

£ Xij > 2 VS C V. 

This replacement of constraints yields an LP that is another equivalent formulation 
of the Held-Karp heuristic. 

Held and Karp proposed several algorithms for finding the optimally weighted 
1-tree [17], [18]. Their most successful approach involves use of a technique known 
as subgradient optimization. Given a concave function /, a vector s is said to be 
the subgradient of / at u if for all u, f(u) + s ■ (u — u) > f(u). It turns out that 
for sufficiently small A, u + As is closer than u to the point at which / reaches its 
maximum value. Let Vk — (^ifc — 2, d2k — 2, ... , d n k — 2), where dik is the degree of the 
zth node of the minimum-cost 1-tree with respect to x, Tk- Held and Karp showed 
that Vk is a subgradient for the function w(ir). They then proposed generating a 
sequence of it vectors (tt 1 , 7r 2 , . . .) according to the rule 

T =T + A :; fi2 V k , 

where < X m < 2 and w is some "target value" such that w(it) <w< max?,- w(tt). 
Notice that this update rule is a formalization of the intuition above of increasing 7r, 
when d{k > 2 and decreasing 7r, when dik < 2. Held and Karp showed that if A m > e 



See Lemma 8 of [16] 
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for some e > for all m, then the sequence of 7r m either converges to or contains 
some 7r such that w(x ) > w. 

No one has yet bounded the number of iterations of subgradient optimization to 
guarantee a polynomial running time. The ellipsoid method of linear programming 
can be used on the LP formulation, since max-flow programs can be used to find 
violated constraints or verify the feasability of solutions. Thus the ellipsoid method 
can find the solution to the Subtour LP in polynomial time [23], [15]. In fact, the 
solution can be found in strongly polynomial time due to a result of Frank and Tardos 
[9]. However, both of these algorithms are considered to be more of theoretical 
interest rather than practical interest. No practical algorithms are known for the 
Held-Karp heuristic that are guaranteed to run in polynomial time. 

The Held-Karp heuristic has proven interesting for a number of reasons. The 
first reason, as mentioned above, is its astonishing accuracy in practice. Johnson 
[19], who uses the heuristic to evaluate the performance of various tour-constructing 
algorithms, estimates that the Held-Karp heuristic usually comes within 99.5% of 
the cost of the optimal solution. The second reason is that the heuristic is used 
as the basis for still more sophisticated heuristics for the TSP. Several researchers 
have used it within branch and bound schemes (see [2]). Grotschel and Padberg use 
the Subtour LP as the basic linear program within their cutting plane approach to 
solving the TSP [28]. 

The reasons for the near-optimality of the heuristic's solutions have not been well 
understood. This thesis investigates the structure of solutions found by the Held- 
Karp heuristic in order to shed light on their accuracy. We consider the symmetric 
case with triangle inequality, the asymmetric case with triangle inequality, and the 
1,2-TSP in Chapters 2, 3, and 4 respectively. 

In the chapter on the symmetric case, we show that instances from two-dimensional 
Euclidean space have planar solutions. We also show that symmetric instances with 
the triangle inequality have a certain monotonicity property: namely, given a graph 
G' induced by removing a node of a graph G, the value obtained by the heuristic 
on G' is not greater than the value for G. With one additional lemma, we give an 
alternate proof of a theorem of Wolsey [39] which shows that the Held-Karp heuristic 
has a 7 = | guarantee for these instances. We explore connections between Held- 
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Karp solutions and solutions to another A r 7 5 -complete problem, the minimum-cost 
biconnected-graph problem. Finally, we conjecture that the Held-Karp heuristic has 
a guarantee of 7 = | and we provide an example which meets this lower bound. 

For the asymmetric case, we consider the extension of the heuristic to the asym- 
metric case proposed by Held and Karp in terms of weighted 1-arborescences. We 
show, using a powerful theorem of Geoffrion [12], that the heuristic can also be 
viewed in terms of weighted 1-antiarborescences, assignment problems, and asym- 
metric 1-trees. We deduce as a corollary that the Held-Karp heuristic has a bound 
that dominates the bound of another non-constructive lower-bound heuristic for the 
asymmetric TSP due to Balas and Christofides [1]. We give the analagous monotonic- 
ity proof for the asymmetric case with triangle inequality and show how this implies 
an 7 = n 1 1 guarantee, matching the best known a = [logn] tour-constructing 
guarantee. 

Finally, for the 1,2-TSP case, we show that the heuristic cannot do better than 
7 = To> even as n tends to infinity. We again investigate connections between Held- 
Karp solutions, the minimum-cost biconnected graph, and the TSP. 



Chapter 2 

The Symmetric Case with 
Triangle Inequality 



Recall from the previous chapter that a TSP instance is symmetric if c t j = Cji for all 
i,j, and obeys the triangle inequality if c t fc + Ckj > Cij for all i,j, k where i, j, and k 
are distinct. The symmetric case of the TSP with the triangle inequality is perhaps 
the most-studied special case of the TSP. It contains the subcase of finding tours 
through points in the plane, where c,j is the Euclidean distance between points i and 
j, since the Euclidean metric is symmetric and obeys the triangle inequality. We will 
call this subcase the Euclidean TSP. One of the earliest papers on solving the TSP 
dealt with the Euclidean TSP, finding a tour through cities of the 48 continental 
states of the U.S. [5]. The Euclidean TSP is jVT-complete [29]. 

2.1 Planarity of Solutions 

We begin this chapter by showing that for any instance of the TSP 1 which has 
an embedding of its nodes in the plane that obeys certain properties, the Held-Karp 
heuristic has an optimal solution that is planar. We will then show that the Euclidean 
TSP with the straightforward "Euclidean embedding" always has a planar solution. 
First we need to define what we mean by an embedding and what it means for a 
Held-Karp solution to be planar. An embedding is a one-to-one mapping from the 
nodes of the instance to points in the plane. The embedding corresponds a distinct 



1 We will assume for the rest of this chapter that any TSP instance referred to is symmetric and 
obeys the triangle inequality. 
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point pi € U 2 with each node i. An embedding does not require the topological 
distance between pi and pj to be the same as the distance Cij between nodes i and j. 
Let x be the optimal solution to the Subtour LP on n nodes, let V = {1, . . . , n}, and 
let Elp — {{i-,j)\xij > 0}. We say ~x is planar if and only if the graph G = (V,Elp) 
is planar. We will show planarity by concentrating on a particular embedding of 
nodes in the plane. If G is planar, then it will have a plane representation for that 
particular embedding of nodes [26]. All that remains to be proved is that given an 
embedding, G has a plane representation, and thus is planar. We will now show that 
any instance of the TSP has a planar Held-Karp solution if there exists an embedding 
that meets two conditions. The first condition is that no three of the points of the 
embedding are colinear. The second condition is that the edge costs obey a property 
called the 602; property. 



Property 2.1.1 (Box Property) Consider an embedding of the nodes 1, . . . ,n of 
a TSP instance into the plane at points pi, . . . ,p n respectively. Pick any four distinct 
nodes i,j,k,l such that the line segments (pi,Pj), (Pj,Pk)> {PkiPl)> an d (pi,Pi) define 
a convex quadrilateral. The embedding of the TSP instance is said to have the box 
property if for any such i,j, k,l, Cij + c« < c, fc + Cji and c,-/ + Cjk < Cik + Cji. 

In other words, an embedding has the box property if for any four points defining 
a convex quadrilateral, the sum of the edge costs of opposing sides of the quadrilateral 
is less than the sum of the diagonals. 

We will now show that given an embedding of an instance with the box property 
and with no three points colinear, there is an optimal solution to the Subtour LP 
that is planar. To do this, we will first show that we can use the formulation of the 
Held-Karp heuristic as a convex combination of 1-trees instead of the Subtour LP 
formulation. Then we will show that if we draw straight line segments between pi 
and pj for every edge (i,j) in the convex-combination solution, intersecting segments 
imply that the solution is not optimal. 

As was noted in Chapter 1, the following linear program is an equivalent formu- 
lation of the Held-Karp heuristic: 
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minimize T,k c kVk, 

subject to: Ylk y k = 1, _ _ 

T,k v ikyk = i = l,...,rc, 
S* > o. 
If y is the optimal solution to this linear program, let Ecc = {(hj)\3k with (i,j) € 
Tfc and y k > 0}. We will show that Ecc = Elp so we can use the edge set Ecc 
when drawing lines in the plane. 

Lemma 2.1.2 Ecc — Elp f° r some optimal solution!; to the Subtour LP. 

Proof: Let y be a feasible solution to (2.1). Set 

*«"i = E y<- 

{*I(»J)€2*} 
We will show that x is a feasible solution of the same cost for the Subtour LP. Since 
the Subtour LP and LP (2.1) both give the same value, if y is optimal, then "x will 
be also. The constraint Xij < 1 follows from J2 k y k = 1 and xij > from y k > 0. 
Furthermore, £ fc v ik y k = implies J2k d ikVk = 2 and thus J2k T^{j\(i,j)eT k } Vk = 2 > so 
that 

E^J +J2^ji = E E 2/fc = 2 - 

3>i J<« 3 {k\(i,j)eT k } 

Moreover, 1-trees have one unique cycle, which contains node 1. So for any 1-tree, 
E 1 < |5| - 1 for any Ar, S C {2, . . . , n} 

{(i,3)\(i,3)eT k ;i,jeS} 

E Vk < Vk{\S\-l) for any k,S C {2, . . . , n} 

W,3)\(h3)eT k ;i,jeS} 

E E Vk < ISl- 1 SC{2,...,n} 

k {{i,j)\(i,j)eT k ;i,jeS} 

E E Vk < \S\-1 SC{2,...,n} 

ijes {k\(i,j)er k } 

E^i < I-S1-1 SC{2,...,n}. 

i,jes 

Thus the subtour elimination constraints are satisfied. The remaining constraints 
for the sets S that include node 1 are implied by the previous constraints. Fi- 
nall y> J2k c kVk = Ei<i<j<nH{k\{i,j)eT k } c ijyk = Ei<i<i<n c ij^j 5 so the two feasible 
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solutions have the same cost. Since Xij = J2{fc|(i j)eTk} 2/*> ^*j > if an °i on ly if 
there exists k such that (i,j) G 7* and j/^ > 0. Hence (i,j) G Ei,p if and only if 
(»',i)G ^cc- ■ 

Thus we can work with the convex combination of 1-trees, knowing that an 
optimal solution to this LP will produce the same set of edges as an optimal solution 
to the Subtour LP. We will now prove that given an embedding with the right 
properties, we can draw straight lines for all edges in Eqc without having any lines 
intersect. 

Theorem 2.1.3 Let pi, . . . ,p n be the embedding of the nodes of an instance of the 
TSP such that the embedding has the box property, and such that no three points pi 
are colinear. Then there exists an optimal solution to the Subtour LP that is planar. 

Proof: Let y be an optimal solution to (2.1). Draw a straight line segment between 
Pi and pj for all (i,j) G Eqc- Suppose that two of these line segments intersect. Call 
them (pi,Pk) and (pj,pi). Since no three points are colinear, pi, pj, p k , and pi must 
form a convex quadrilateral. The two line segments (pi,Pk) and (pj,pi) correspond 
to edges (i,k) and (j,/). Suppose that both edges (i,k) and (j,l) are in a single 
1-tree, T q . Since any 1-tree is connected and (i,k) and (j,l) are in T q , there exists a 
path in T q either from i to j, from j to k, from k to /, or from I to i that does not 
pass through either of the other two nodes. Without loss of generality, suppose that 
the path is from i to j, and it does not pass through k or /. Create a new 1-tree T r 
from T q by removing (i,k) and (j, I) and adding (i,/) and (j,k). The path from i 
to j ensures that T r is connected. See Figure 2.1. Let y' k — yu for k ^ q,r, and let 
y' q — and y' r = y r + y q . It is not difficult to see that since y is feasible for (2.1), so 
is y'. By the box property, since pi, pj, pk, pi formed a convex quadrilateral, we have 
c il + c jk < c ik + c jl- Therefore, Ylk c kVk < Ylk c kVk- This contradicts our hypothesis 
that y is an optimal solution to (2.1). 

Now suppose that the edges (z, k) and (j, I) corresponding to the crossing line 
segments come from two different 1-trees, (i,k) from T q and (j,l) from T r . Without 
loss of generality, suppose that y q < y r . There are two classes of ways that T q and T r 
can be connected, so again, without loss of generality, we will pick one example from 
each class and assert that the other cases in each class are similar. For the first class, 
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Figure 2.1: Example if crossed lines are in a single 1-tree 



we will say that T q has paths from i to j and from k to / (without going through k, I 
and through i,j respectively), and T r has paths from i to j and from j to k. In this 
first class of cases, we are able to remove the "diagonal" edges from the trees and 
replace them with "opposing sides" while keeping the 1-trees properly connected: in 
this case, we create T ql from T q by removing (i,k) and adding (j, k), and T r \ from T r 
by removing (j,/) and adding (i,/). We set y' ql = y q i + y q , y' rl = y r i + V q , v' T = Vr-Vq-, 
y'„ — 0, and y' k = yk elsewhere, y' is feasible for (2.1) since y is, but the difference 
in cost between the two solutions is y q (cu + c jk ) - y q (c ik + Cji). This difference is 
negative by the box property, so y' is a cheaper solution to (2.1), contradicting the 
optimality of y. 

For the second class, we will say that T q has paths from i to j and from k to 
/, and T r has paths from i to / and from j to k (again, the paths do not visit the 
other two nodes). Create four new 1-trees: T q \ from T q by deleting (i,k) and adding 
(j,k), T q2 from T q by deleting (i,k) and adding (i,l), T rl from T r by deleting (j,/) 
and adding (i,j), and T r2 from T r by deleting (j,l) and adding (k,l). See Figure 2.2. 
It is not difficult to check that all the new 1-trees are properly connected. Now, let 

V'ql = Vql + ^Vq, V q 2 = Vq2 + fyq , Vrl =2/rl + 52/,, 2/' 2 = Vr2 + \y q , Vr = Vr-Vq, Vq = 0, 

and y' k = yk elsewhere. Since y is feasible for (2.1), so is y'. However, the difference 
in cost between the two solutions is \y q {cij + Cjk + cm + c/,-) - y q (cik + Cji). By the 
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box property this difference is negative, so y' is a cheaper solution, contradicting the 
optimality of y. 

In all cases, the existence of crossing line segments leads to a contradiction. Thus 
the embedding of the TSP instance must yield some optimal solution x such that 
G = (V, Elp) has a plane representation for that embedding. By previous discussion, 
this proves that x is planar. ■ 

In the case of the Euclidean TSP, there is a natural "Euclidean embedding" of 
the nodes into points in the plane such that for any nodes i and j, c,-j = d(pi,pj), 
where d(pi,pj) is the Euclidean distance between points pi and pj. We will show that 
given this Euclidean embedding for an instance of the Euclidean TSP, there is always 
an optimal solution to the Subtour LP that is planar. We will do this by showing 
that the Euclidean embedding always has the box property, and that we can drop 
the restriction of colinearity from the theorem above. 

Lemma 2.1.4 The Euclidean embedding for a Euclidean TSP instance always has 
the box property. 

Proof: Letpi, . . . ,p n be the Euclidean embedding of nodes 1, .. . , nfrom a Euclidean 
TSP instance. Pick any four distinct nodes i,j,k,l such that the line segments 
{PiiPj)i (PjiPk), (Pk,Pl), and (pi,Pi) define a convex quadrilateral. Then the diagonals 
(pi,Pk),(Pj,Pi) of the quadrilateral intersect at exactly one particular point in K 2 . 
Call this point q. Since q does not lie on the any of the line segments (pi,Pj), (p k ,Pi), 
(pi,Pi), and (pj,Pk), the following statements hold under the Euclidean metric: 

• d(pi,pj) < d(pi,q) + d(q,pj) 

• d(p k ,pi) < d(p k ,q) + d(q,pi) 

• d(p hPi ) < d(p h q) + d(q,pi) 

• d( Pj ,p k ) < d(p jf q) + d(q,p k ) 

Adding the first two statements together gives d(pi,pj) + d(p k ,pi) < d(pi,q) + 
d(q,Pk)+d(pj,q) + d(q,pi), and adding together the last two gives d(pi,pi)+d(pj,pk) < 
d(pi,q) + d(q,p k ) + d(pj,q) + d{q,p\) (using symmetry). But d(p { ,q) + d(q,p k ) = 
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Figure 2.2: Example if crossed lines are from two 1-trees 
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d(pi,pk) and d(pj,q) + d(q,pi) = d(pj,pi), since q lies on the line segments (pi,p k ) 
and (pj,pi). Because this is a Euclidean embedding of a Euclidean TSP instance, 
Cij = d(pi,pj), cm = d(pk,pi), and so forth. Thus c^ + c k \ < c ik + Cji and cu + Cj k < 
c ik + c jt . ■ 

Finally, we remove the restriction on colinearity for the Euclidean TSP. 

Theorem 2.1.5 Given the Euclidean embedding for an instance of the Euclidean 
TSP, there exists an optimal solution to the Subtour LP that is planar. 

Proof: Observe that for the Euclidean TSP d(pi,pj) + d(p k ,pi) < d(pi,p k ) + d(pj,pi) 
and d(pi,pi)+d(pj,p k ) < d(pi,p k )+d(pj,pi) even when pj or p t lies on the line segment 
(pi,Pk), or when pi or p k lies on the segment (pj,pi). Hence, using the reasoning 
found in Theorem 2.1.3 and Lemma 2.1.4 above, intersecting line segments of this 
type contradict the optimality of y, the optimal solution to 2.1. 

We must now handle the general case when three or more points are colinear. Let 
x be an optimal solution to the Subtour LP, with the subtour elimination constraints 
replaced by YlieS } jiS x ij ^ 2 constraints. By the reasoning above, drawing straight 
line segments for all edges in Elp yields no intersecting line segments unless all 
the points corresponding to the intersecting segments are colinear. Without loss of 
generality, suppose that points p\, . . . ,p k are colinear, in numerical order on the line. 
Suppose also that drawing straight lines for all edges in Elp causes lines to be drawn 
through points P2, ■ ■ ■ ,Pk-i', that is, for each node i € {2, . . . , k - 1}, there is some 
edge (a, b) 6 Elp with l<a<i<b<k. 

Let S = {1, . . . ,k}. Let t = X)jgs ^lj and t k = Yljg S x k j. Furthermore, we set 
t{ — I3i<a<i<6<fc^a6 for i = 1, . . . ,k — 1. That is, ti will be the sum of the £ a j, that 
"get drawn" between nodes i and i + 1. Since the degree of nodes 1 and k is 2, it 
follows that to + ti = 2, and t k _\ -\-t k = 2. 

Suppose S ^ V . Since x is a solution to the Subtour LP, we know that 
J2ies,j$s%ij ^ 2. For i € {2, . . . ,k - 1}, there is no (i,j) € Elp with j £ S. If there 
was such an edge (i,j), then since there exists an edge (a, 6), 1 < a < i < b < k, 
with pi on the line segment {p a ,Vb)i we have a contradiction by the discussion of the 
initial paragraph. Therefore, Y^,ieS,j<£S%ij = X^gsC^ij + %kj) ~ t + t k > 2. Using 
S' = {1, . . . ,k — 1} and S" = {2, . . . , k], one can show similarly that to + t k _\ > 2 
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and t\ + tk > 2. Solving with the equations above yields to = ti = t^-i = tk — 1- 
Then using S i = {i + 1, . . . , A;}, we get /,• + ^ > 2, which imphes t t > 1. We now 
construct a new solution to the Subtour LP which has no greater cost: £~' ? , +1 = 1 
for i = 1, . . . , k - 1, x[j = xij for j > k, x' k - = x k j for j > k, and x^ = Xj t for 
j, Z > it. Clearly for the Euclidean TSP this solution has no greater cost, since in 
the old solution U > 1. The node degree constraints are satisfied, since each node 
has degree 2. Suppose that there is some set T such that Z^'exjgT^ij < 2. Then it 
must be the case that T D S = {1, . . . , i} or T D S - {i, . . . , k} for 1 < i < k. For 
any other possible T n 5, it is clear that £; e xjgr ^ij > 2 - ^ some set of the form 
Tn5 = {l,...,{}orTn5'= {i,...,k} is infeasible for x', then T U 5 must also be 
infeasible for x'. However, this implies T I) S was infeasible for x, a contradiction. 
Hence x' is an optimal solution for the Subtour LP, and it no longer has intersecting 
line segments for the colinear points p\, . . . ,pk- 

Suppose S = V . Using arguments similar to those above, it can be shown that 
ti > 2 for 1 < i < n — 1. Hence the solution x\ i+l = 1 for 1 < i < n - 1, ~x~' ln = 1 
is of no greater cost. Since the solution is a tour, it is clearly feasible, and it can be 
drawn in the plane by using straight line segments between pi and pi + i for the edges 
(z, i + 1), and a curve between p\ and p n for the edge (1, n). ■ 

Planarity may be useful in discovering further structure of solutions for the Sub- 
tour LP, and perhaps even proving tight lower bounds. Planar graphs have many 
nice properties not shared by their non-planar counterparts. For instance, it is known 
that every 4- vertex-connected planar graph has a Hamiltonian cycle (that is, a tour) 
[35], [36]. 



2.2 Monotonicity of Solutions 

The Held-Karp heuristic on symmetric instances of the TSP with triangle inequality 
has a certain monotonicity property, which we will define and prove in this section. 
As a consequence of this theorem, we derive an alternate proof of Wolsey's 7 = 3 
lower bound on the cost of Subtour LP solutions. That is, the Held-Karp heuristic 
will always produce a solution that has cost no less than ^OVT. Monotonicity will 
allow us to prove this statement by bounding the value of the Held-Karp heuristic 
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on subsets of nodes in a useful way. 

Let V = {l,2,...,n} be the set of nodes, and let O C V. Let W be the cost 
of the Subtour LP, and let Wo be the cost of the Sub tour LP on the node set O. 
We will say that the Subtour LP is monotone if for any TSP instance with node 
set V, and for any O C V, Wo < W. If n < 5, then it is well known that the 
extreme points of the polytope defined by the Subtour LP (1.1) are integral [16]; i.e., 
they correspond to tours. Thus, in this case, the triangle inequality implies that an 
optimal tour on V can be shortcut to yield a tour on O that is no longer. So the 
Subtour LP is monotone for n < 5. Consider next n > 5. By observing that the 
Subtour LP (1.1) is independent of the choice of the special node 1, we can assume 
that, without loss of generality, O - {1, . . . , n - 1} = [n - 1]. We shall show that 
assuming W[ n -i] > VV leads to a contradiction. We will draw heavily on Held and 
Karp's alternate formulation of the Subtour LP as an optimally weighted 1-tree. 

Define the adjusted cost of a 1-tree T a with respect to 7r to be 

n 

Note that when T a is the minimum-cost 1-tree with respect to 7r, its adjusted cost 
is w(ir). Let T = T* and W = (7T1, . . . ,7r n _i) be the optimal 1-tree and the optimal 
Lagrangean multipliers for [n — 1], respectively, so that 

n-l 

W[ n _!] =c k + ^2xiv ik . (2.2) 

4 = 1 

We first show that T and W can be picked such that the two edges adjacent to 
node 1 have the same reduced cost. 

Lemma 2.2.1 There exists a vector ¥ for [n — 1] for an optimally weighted 1-tree T 
such that if node 1 is adjacent to nodes x and z, C\ x = C\ z . 

Proof: Suppose that in T, node 1 is adjacent to nodes x and z, and c.\ x < ~c~\ z . This 
implies that (l,a;) must be the single cheapest edge adjacent to 1, so all optimal 
1-trees with respect to the Lagrangrean multipliers Tr must include (l,x). Consider 
again the linear program (2.1), the convex combination of 1-trees. By complementary 
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slackness, each tree Tk for which y k ^ in (2.1) is an optimal 1-tree with respect to 
¥ in the dual LP (1.2). As noted above, (l,x) must be in each of these trees. The 
node x will have degree at least two for each tree, as it will be in the unique cycle of 
the 1-tree. Since the convex combination of 1-trees forces the average degree of each 
node in the trees to be 2, x must have exactly degree two for each tree in the dual 
solution. 

Pick one such tree Tfc. Since x has degree 2, increasing T x will not change the 
adjusted cost of Tk from the optimum value, W[ n _i]. We show that this does not 
affect the optimality of the spanning tree of Tk on 2, . . . , n - 1. Increasing Tt x does not 
affect the relative order of the reduced cost of edges incident to x, and does not affect 
the reduced cost of any other edge. Since x is a leaf in this spanning tree, the edge 
incident to x is the cheapest such edge, and if Tr^ is increased a minimum spanning 
tree will contain this edge. Clearly, all other edges will remain in the spanning tree 
as well. 

If node zis also adjacent to node 1, and we increase T x by c\ z — ci x , then (l,x) and 
(l,z) are still the two cheapest edges adjacent to 1, but Z\ x = c\ z . By the arguments 
above, 1*. is a minimum-cost 1-tree with respect to the modified multipliers W such 
that Tk has adjusted cost W[ n _i]. Thus Tk and the new W are optimal solutions to 
the equation (2.2). ■ 

We will now assume that W[„_i] > W and show that this leads to a contradiction. 
Let T(7r n ) be the minimum-cost 1-tree on V with respect to W for nodes in [n — 1] 
and 7r„ for node n. If the adjusted cost of T(n n ) is greater than or equal to W[ n _i] 
for any ir n , then by supposition it is greater than W. Thus we have found a vector 
■k for which the minimum-cost 1-tree on V has adjusted cost greater than W, which 
contradicts the maximality of W. 

Thus, T(-K n ) must have adjusted cost less than W[„_ 1 ]. We will show that we can 
delete node n from some T(n n ) such that the adjusted cost of the resulting 1-tree 
is no greater, which contradicts the minimality of T with respect to W. Thus the 
supposition W < W[„_x] must be false. 

We now show that there exists 7r n such that n has degree two in T(ir n ). 

Lemma 2.2.2 If node n in T(ir n ) has degree k < n- 1, then there exists 6 > such 
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that n has degree k + 1 in T(x n — 6). 

Proof: By the definition of a minimum-cost 1-tree, T(n n ) is a minimum-cost span- 
ning tree on V — {1} plus the two cheapest edges adjacent to node 1, all with respect 
to the reduced costs Cij. We can assume that the minimum-cost spanning tree is 
constructed as follows: sort the edges in non-decreasing order by reduced cost; in- 
clude in the tree those edges that connect two connected components in the graph 
induced by the edges that come earlier in the ordering. Note that by changing 6, 
only the costs of edges incident to n are altered, and these changes can only move 
those edges earlier in the order. Furthermore, if an edge is included, it will still be 
included after moving it earlier in the order. 

For a particular value of 6, there may be many orderings of the edges consistent 
with the reduced costs (due to ties in the values). In an ordering, we can interchange 
any two edges of the same reduced cost. Perform a series of interchanges, bringing 
the edges incident to n earlier in the order, one step at a time. If the degree of n 
increases as a result of one of these interchanges, we have proved the lemma. Next 
consider the edges incident to node 1, and check if the edge (1, n) is of the same cost 
as one of the edges in the current solution. Again, if the degree of node n increases, 
we are done. 

Apply the above argument with S — 0. If this fails to produce the desired tree, 
increase 6 until the reduced cost of one of the edges incident to n equals the reduced 
cost of one of the other edges in the graph, and then repeat the procedure given 
above for a the new value of 6. Note that if S is sufficiently large (greater than 
maxj{cj„} — min t j{c,j}) then the degree of node n must become n — 1. Therefore, 
the procedure given above must terminate and give a 1-tree in which node n has 
degree k + 1. ■ 

Corollary 2.2.3 There exists a value ~K n such that node n has degree two in T(iv n ). 

Proof: This follows from Lemma 2.2.2 and and the observation that if 7r„ is suffi- 
ciently large, then it must have degree 1 in any minimum-cost 1-tree. ■ 
We can now prove the theorem. 

Theorem 2.2.4 W[ n _ 1 ] < W and thus the Subtour LP is monotone. 
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Proof: Assume, as we have above, that W[ n _i] > W, and that T = T k and W are the 
optimal 1-tree and multipliers for [n - 1]. Let W n be such that node n has degree two 
in T(W n ) = T a , and let w and x be the two nodes adjacent to n. If (w,x) is not in 
T a , then form the 1-tree Tb by removing edges (w,n) and (x,n), and adding (w,x). 
Since u na = 0, u, a = t>;t, and c wx < c nx + c ri 



~nwi 



Cfe + E"=l 1 *i v ib < Co, + Tt n V na + Y^=l *i v ia 



n-1... ( 2 - 3 ) 



which contradicts the minimality of T(= Tk) with respect to the multipliers ¥. 

Suppose that the edge (w,x) is already in T(X n ). This means that there is a 
cycle (n, u;, a;), and since node 1 is in the unique cycle in a 1-tree, either w or x 
must be node 1. Say that w = 1. By the optimality of T(¥„), (l,x) must be one of 
the edges adjacent to node 1 in T. By Lemma 2.2.1, there exists another edge (1,2) 
with Ciz = C\ x . So we can remove edge (l,x) and add (1,2) without affecting the 
optimality of T(W n ). (l,x) = (w,x) is no longer in the tree, so we can shortcut node 
n as above. 

This establishes the desired contradiction, so it must be the case that W[„_i] < 
W. m 

This theorem was also obtained independently by Goemans and Bertsimas [13]. 

To achieve the same 7 = § lower bound on the cost of the Subtour LP as Wolsey 
[39], we use a result of Christofides. Christofides [3] observed that if T is the cost 
of a spanning tree, and M is the cost of a matching on the odd-degree nodes of the 
tree, then M + T > OVT. This comes from the fact that a tree plus a matching on 
the odd-degree nodes yields an Eulerian graph. By starting with an Eulerian circuit 
of the graph and shortcutting any multiply visited nodes, we can obtain a tour no 
longer than the total length of edges in the Eulerian graph. The same holds true if 
a 1-tree is used instead of a spanning tree. 

If we assume that there is an even number of nodes, the cost of a matching can 
be bounded in terms of W. 

Lemma 2.2.5 Let Ai be the cost of the minimum-cost matching, assuming that 
n — \V\ is even. Then Ai < \W . 
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Proof: Let x be an optimal solution to the Subtour LP. Then \x satisfies the 
following constraints: 



i=l,2,...,n, (2.4) 

S CV, \S\ >3, | SI odd, 

1 < i < 3 < n, 
1 < i < j < n. 

By a classic result of Edmonds [6], these are exactly the constraints for the linear 
programming formulation of the matching problem. Since the objective function for 
the two LPs is exactly the same (min Y^\<i<j< n c ij x ij) anc ^ \ x 1S a f easiD l e solution 
to (2.4), the cost of the matching is no greater than half the cost of the Subtour LP. 
Thus M < \W. M 

Pick a minimum-cost 1-tree T s with 7r 4 - = 0, for all i. This implies c s < W. Let 
O C V be the odd-degree nodes of T. Then 



OVT < c s + Mo (2-5) 

OPT < W + ^Wo (2.6) 

OVT < W + ^W (2.7) 

OVT < |>V 

-OVT < yv 

o 

Equation (2.5) follows from Christofides' technique, (2.6) follows from Lemma 
2.2.5, and (2.7) follows from the monotonicity theorem. Therefore, W, the value 
of the Subtour LP, is bounded above by OVT and bounded below by \OVT . We 
note that this result shows that the Held-Karp heuristic does as well as the best- 
known tour-constructing heuristic for the symmetric TSP with triangle inequality. 
Christofides' heuristic [3] is guaranteed to construct a tour with cost no greater than 
\OVT. 
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The 7 = | lower bound for the Held-Karp heuristic is not known to be tight. The 
worst case known is a family of graphs shown in part (a) of Figure 2.3, which was 
introduced by Monma, Munson, and Pulleyblank [27] in a slightly different context. 
Let the distance from any node i to any node j of the graph be the number of edges 
in the shortest path between i and j. This yields an instance of the TSP that is 
symmetric and obeys the triangle inequality. Part (b) of the figure shows an optimal 
tour of the graph of cost 4k + 2. Part (c) shows a feasible solution to the Subtour 
LP of cost 3k + 3. Since there are 3k + 2 nodes in the graph, and each edge costs 
at least one, the cost of the optimal solution to the LP is at least 3k + 2. Then the 
ratio of the cost of the LP solution to the cost of the optimal tour is between |^i| 
and §££§• Notice that this ratio tends to | as k tends to infinity. We conjecture that 
the actual lower bound for the Held-Karp heuristic is 7 = |. 

2.3 Connections to the Biconnected Graph Problem 

Monma, Munson, and Pulleyblank [27] have shown that there are interesting connec- 
tions between the TSP, the Held-Karp heuristic, and another TVP-complete problem, 
the minimum- cost biconnected- graph problem. We say a graph G = (V,E) is bicon- 
nected if the graph is connected, and the removal of any edge does not disconnect 
the graph. Given costs C{j the minimum-cost biconnected-graph problem is to find 
E' such that G = (V, E') is biconnected and 



yz c ij — m ^ n z_> 

{lj)eE ' { S K G < S ) biconnected } {iJ)€S 



Ci 7 . 



Eswaran and Tarjan [8] have shown that the minimum-cost biconnected-graph prob- 
lem is A/^P-complete even when edge costs are either 1 or 2. 

Monma, Munson, and Pulleyblank have shown that if the Cij are symmetric and 
obey the triangle inequality, then the minimum- cost biconnected graph is a 7 = j 
lower bound for the TSP 2 . They also show that this bound is tight, by using the 
same family of graphs as our conjectured worst-case instance for the Held-Karp 
heuristic. Furthermore, they include a result of Cunningham that shows that the 
optimal solution to the Subtour LP has cost no greater than that of the minimum-cost 



2 Frederickson and Ja'Ja' [10] showed earlier that this was true for planar graphs. 
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Figure 2.3: Conjectured Worst Case for the Held-Karp Heuristic 
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biconnected graph. 

We draw an additional connection to the minimum- cost biconnected-graph prob- 
lem by relating the value of its linear relaxation to the value of the Held-Karp heuris- 
tic for non-negative c,-j. Consider the following linear program: 



minimize 2_J Cij^ij (2-8) 

subject to: ^ x ij + z2 x J i — ^' i = 1, 2, . . . , ra, 

y^ x^ > 2, for any proper subset S C V, 

i£S,j$S,i<j 

Xij < 1, 1 < i < j < n, 

x^ > 0, 1 < i < j < n. 

As with the Subtour LP, if the x^ in LP (2.8) were guaranteed to be either or 
1, the solution would be the minimum-cost biconnected graph. Therefore (2.8) is a 
linear relaxation of the biconnected-graph problem in the same way that the Subtour 
LP is a linear relaxation of the TSP. If we let W be the cost of the optimal solution 
to Subtour LP and B be the cost of the optimal solution to (2.8), it is not too hard 
to see that B < W. If the subtour elimination constraints of the Subtour LP are 
replaced by Ylies jiSi<j x ij ^ 2 constraints, any x that is feasible for the Subtour 
LP is feasible for (2.8), and so B < W. We show that W and B are in fact equal for 
a large number of cases. 

Theorem 2.3.1 Ifcij > for all i,j, then W = B. 

Proof: Define the potential function $ to be 

*(z) = E(E^ + !>;>• - 2 )- 

i j>i 3<i 

Intuitively, $(x) is the total amount that the degree of each node in a solution to 
the biconnected LP (2.8) exceeds 2. Pick the vertex x of the polytope defined by the 
biconnected LP such that Yli<i<j<n c ij x ij = & (that is, x is an optimal vertex) , and 
such that $(a;) is minimized. If $(a;) = 0, then we are done, since x will be feasible 
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for the Subtour LP, implying W < B and thus W = B. Suppose that $(z) > 0. 
We will derive a contradiction by finding a feasible point x of no greater cost (i.e., 
x is optimal) such that <£(z) < $(x). Since x is the convex combination of optimal 
vertices and $ is a linear function, there must exist some optimal vertex x' of the 
polytope with <fr(x') < <J>(a;). The existence of x' will complete the contradiction. 

Recall that a multigraph is a graph such that there may be more than one edge 
between any two nodes, and an Eulerian graph is a graph in which each node has 
an even number of edges incident to it. Our proof relies heavily on the following 
theorem of Lovasz about Eulerian multigraphs. 

Theorem 2.3.2 (Lovasz [25]) Let G be an Eulerian multigraph, z a node of G, 
and (z,u) an edge ofG. Then there exists another edge (z,v) in G such that in the 
graph G' formed by removing (z,u) and (z,v) from G and adding (u,v) 

c G >(a,b) = c G (a,b) 

where a,b are any two nodes of G distinct from z, and where ca(a,b) denotes the 
number of edge-disjoint paths between a and b. 

We will convert our optimal vertex x into an Eulerian multigraph by multiplying 
each X{j by a constant factor. Since x is a vertex of the polytope, the Xij must be 
rational. Thus we can find some least common denominator q of 212, £13, . • • ,a; 7i _i )7i . 
The multigraph G x induced by 2qx (that is, the graph with 2qxij edges between 
nodes i and j) is then an Eulerian multigraph. 

Choose a node z such that Ylj> z x zj + J2j< z x zi > 2- Such a node z must exist 
since $(x) > 0. Then z must have degree at least 2q + 2 in G x . Apply Lovasz's 
theorem to z in G x for some arbitrarily chosen u such that (z,u) is in G x . The 
theorem produces a new graph G x that shortcuts the node z; that is, edges (z,u) 
and (z,v) are removed for some u, and edge (u,v) is added. Consider the vector x 
with Xij equal to the number of edges (i,j) in G x divided by 2q. It will be shown 
that if x uv < 1, then we are done. Otherwise there will be two cases to consider. 
First we suppose that x uv < 1. 

Lemma 2.3.3 Ifx uv < 1, then x is a feasible point for the biconnected LP such that 
the cost ofx is no greater than the cost of x and $(af) < $(x). 
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Proof: By construction, x uv = x uv + ^, x zu - x zu - ±, x zv — x zv - ^, and x^ = Xij 
everywhere else. Thus certainly $(af) < $(x), and also the cost of x is no greater 
than the cost of x by the triangle inequality. Since z had degree at least 2q + 2 in 
G x , it must have degree at least 2q in G x , and hence at least degree 2 in x, so all 
the node degree constraints of the biconnected LP are satisfied. Likewise, because 
(z,u) and (z,v) were in G x , x zu > | and x zv > |, so x > 0. By the assumption and 
observations above, x < 1. 

Finally, we need to show that the Y.ieS,j$s,i<j x ij ^ 2 cut constraints are obeyed. 
Since J2ies jiSi<j x n - 2 , it follows from the max- flow min-cut theorem that 
ca x (a,b) > Aq for all distinct nodes a and b. By Lovasz's theorem c-Q x (a,b) > Aq for 
all nodes a and b different than z. Hence for every subset S such that there exists 
a e S,b £ S, with a,b ^ z, X).gs,j^5,i<j^«'j ^ 2 - Tne on ^y case * n wnicn this does not 
occur is when S = {z} or ~S = {z} in which case these cut constraints follow from 
the node degree constraint for z. ■ 

Now we suppose that the lemma does not apply; that is, there does not exist 
edges (z,u) and (z,v) such that Lovasz's theorem applies without causing x uv > 1. 
There are two cases to consider. First, suppose that for every pair of edges (z, u) and 
(z,v) adjacent to z, x uv = 1. There must exist at least three distinct points u,v,w 
with x zu > 0,x zv > 0, and x zw > (otherwise, the degree of z can't be greater than 
2). Also note that x zu > implies that x zu > | and similarly for the other edges. 
By assumption, x uv = x vw — x uw = 1. Then we assert that setting x uv = x uv - ^ 
and Xij = Xij elsewhere produces a feasible point x for the biconnected LP. It has no 
greater cost (since c uv > 0) and $(x) < $(2) (since the degree of u has decreased). 
The feasibility of x for all constraints follows straightforwardly except for the cut 
constraints for which u £ S,v g S. Then we have the following cases: 

• z,w e S implies J2ieS,jiS,i<j x ij ^ x uv + x vw + x zv >2 + ^, 

• z e S,w <£ S implies Y.ieS,j<£S,i<j x ij > x uv + x uw + x zw > 2 + ^, 

• z g S,w € S implies J2ieS,j$s,i<j x ij > x uv + x vw + x zw > 2 + ±, 

• z,w g S implies 12ies,jis,i<j x ij ^ x uv + x uw + x zw >2 + ±. 
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Figure 2.4: Case 1 if Lemma 2.3.3 does not apply 

In every case the cut is not less than 2 + ^, so we can certainly reduce x uv by ^. 
See Figure 2.4. 

The second case to consider if Lemma 2.3.3 does not apply is when (z,v) and 
(z,w) are non-zero edges with x vw < 1, but choosing (z,v) causes Lovasz's theorem 
to choose (z,u) such that x uv = 1, and choosing (z,w) causes the theorem to choose 
(z,y) with x wy = 1 (possibly u = y). It turns out that in this case we can obtain 
a feasible point x by setting x vw = x vw + j^, x zv = x zv - j^, x zw = x zw — j^, and 
Xij = Xij everywhere else. Again, showing that the cost of x and $(x) are no greater 
than those of x is trivial. Likewise, showing feasibility for all constraints is easy 
except for the cut constraints in which z € S, v,w g S. Since Lovasz's theorem says 
we could have shortcut to (u, v) or to (w, y), it follows that for all S with z £ S and 
either u,v g S, or w, y £ S, Ylies,iis,i<j x ij ^ 2 + \- $° ^e only case remaining is 
when u and y are in S. Then J2ieS,j<£S,i<j x ij ^ x uv + x wy + x zw > 2+^. Thus, we can 
produce an x by shortcutting to (v,w) without violating any of the cut constraints. 
See Figure 2.5. 

In every case, we have produced a feasible point x with the necessary properties, 
so we have reached a contradiction, and the theorem is proven.B 

A more general version of this theorem was proven independently by Goemans 
and Bertsimas [13], also by using Lovasz's theorem. 
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Figure 2.5: Case 2 if Lemma 2.3.3 does not apply 



That W = B is true in a large class of instances is somewhat surprising, especially 
since the minimum-cost biconnected graph generally does not have the same cost as 
the minimum-cost tour in the same class of instances. The equality of W and B 
also implies that we have another equivalent formulation of the Held-Karp heuristic 
in the biconnected LP. Goemans and Bertsimas [14] use this formulation in their 
probabilistic analysis of the Held-Karp heuristic; it is possible that this formulation 
will continue to be useful in further analysis of the heuristic. 



Chapter 3 

The Asymmetric Case with 
Triangle Inequality 



A TSP instance is said to be asymmetric if it is not necessarily the case that c,-j = 
Cji for all i,j. The asymmetric case seems to be harder than the symmetric case 
of the TSP: even with the triangle inequality, the best known tour-constructing 
heuristic has a = [logn] [11]. Non-constructive heuristics seem to do as well as their 
symmetric counterparts, however. A lower-bound heuristic of Balas and Christofides 
[1] produced values that were usually 99.5% OVT in one study of the heuristic [4]. 
The Held-Karp heuristic on asymmetric instances is also doing well. We will show 
that the Held-Karp heuristic has a guarantee of 7 = n* , and has a bound no less 
than that of the Balas-Christofides heuristic. 

3.1 Definition of the Asymmetric Held-Karp Heuristic 

First, we must define the Held-Karp heuristic in the asymmetric case. An arbores- 
cence on a directed graph G = (D,A) is a tree such that each node of the tree has 
indegree one with the exception of a distinguished node known as the root, which has 
indegree zero. Thus there is a directed path from the root to every other node. A 
1-arborescence is an arborescence having node 1 as the root and one additional arc 
(i, 1). So a 1-arborescence has exactly one directed cycle, which contains node 1. As 
in the symmetric case, the 1-arboresence can be weighted by Lagrangean multipliers 
a = (eti, . . . ,a n ), so that the minimum-cost 1-arborescence is chosen with respect to 

42 
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reduced costs C{j = c,-j + a,-. If T^ is the minimum-cost 1-arborescence with respect 
to a, and 

n 

(i,j)er k 1=1 

then the value of the Held-Karp heuristic in the asymmetric case is max w(a). 
Held and Karp [17] noted that their results for the symmetric case carried over 
straightforwardly to the asymmetric case. In particular, their statement implies that 
the value of the Held-Karp heuristic is equal to the value of the following linear 
relaxation of the asymmetric TSP: 



minimize Y^ CijXij (3-1) 

l<t'J<n 

subject to: zL x ij = 1? j=l,...n, 



/ j X{j — J-> ^ — 1, . . . , 71, 



J 



y^ X{j < \S\ — 1, for any proper subset S C V 
X{j > 0, 1 < i,j < n. 

Held and Karp do not formally prove that max a w(a) and the value of the LP (3.1) 
are equal. We will do so here by using a powerful theorem of Geoffrion. Geoffrion 
[12] examines Lagrangean relaxation in a general setting by considering the following 
linear programs: 



minimize ex 

subject to: Ax > b, ,_ ^, 

Bx > I ^ 

x > 0, 

/(A) = minimize ex + X(b — Ax), 

subject to: Bx > d, , . 

x > 0, {6J) 

Xi integer, 

where A is fixed, and, 
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maximize over A /(A) 

subject to: A; > when A{X > &;, (3.4) 

A,- unrestricted when A{X = b{. 

Geoffrion then shows the following theorem. 

Theorem 3.1.1 (Geoffrion [12]) Suppose that for all feasible A, the optimal value 
of (3.3) is not altered by dropping the integrality constraints. Then the optimal value 
of (3.2) is equal to the optimal value of (3.4)- 

Now we can prove Held and Karp's theorem for the asymmetric case. 

Theorem 3.1.2 (Held, Karp [17]) Let W be the optimal value of the asymmetric 
Subtour LP (3.1). Then W = max a w(a). 

Proof: To apply Geoffrion's theorem, we have c correspond to the Cij, x correspond 
to the Xij, Ax > b correspond to the constraints 52 • Xij = 1, i = 1, . . . , n, and Bx > d 
correspond to both YLi x >j — 1> J = 1> • • • > n > an< i the subtour elimination constraints 
^ies,jeS x ij < 1^1 - 1 f° r an Y S C {2,. ..,n} or any S — {l,k} for k e {2,...,n}. 
First, notice that the optimal value of (3.2) will be the same as that of the asymmetric 
Subtour LP (3.1) 1 . Second, if the Xij are forced to be integers, then only vectors x 
corresponding to 1-arborescences satisfy the Bx > d constraints. Hence we can view 
the linear program (3.3) as finding the 1-arborescence that minimizes ex — A(6— Ax). 
But ex — X(b - Ax) — J2ij(cij + \{)xij — Yli A;, so minimizing this quantity is the 
same as finding the minimum-cost 1-arborescence with respect to A. Therefore, the 
value of the LP (3.3) is equal to the value of w(X), and the value of (3.4) is the same 
as the value of the Held-Karp heuristic. 

It will follow that the optimal value of the asymmetric Subtour LP is equal to 
the value of the Held-Karp heuristic if the polytope Bx > d has integer extreme 
points. By a theorem of Edmonds [7], Bx > d has integer extreme points because 
it represents the intersection of two matroids (the 1-tree matroid and the indegree 1 
matroid). ■ 

The choice of which constraints from the asymmetric Subtour LP to assign to 
Ax > b and which to assign to Bx > d was somewhat arbitrary, so it turns out 
: As before, the missing constraints are implied by other constraints. 
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that we can prove similar theorems not considered by Held and Karp. We state 
a few of the possible theorems below. A few terms need to be defined first. A 1- 
antiarborescence is the same as a 1-arborescence, except that each node is constrained 
to have outdegree 1, rather than indegree 1. An asymmetric 1-treeis a directed graph 
whose underlying graph is a 1-tree. 

Theorem 3.1.3 Define the minimum-cost 1-antiarborescence with respect to a real 
n-vector (3 = (/?i, . . . , /?„) to be the minimum-cost 1-antiarborescence with respect to 
edge costs Cij — c,-j + j3 3 . IfTk is the minimum-cost 1-antiarborescence with respect 
to j3, define 

n 

(i,j)er k j=i 

Then m&xp w(/3) = W. 

Theorem 3.1.4 Define the minimum-cost asymmetric 1-tree with respect to the real 
n-vectors a — (c*i, ... ,a n ) and (3 = (/?i, . . . ,/?„) to be the minimum-cost asymmetric 
1-tree with respect to edge costs c^ = c,j + a; + (5j. If T^ is the minimum-cost 
asymmetric 1-tree with respect to a,fi, define 

n 

(«',j)eT fc i=l 

Then max a/ g w(a,(3) = W. 

Theorem 3.1.5 Index all the proper subsets S CV by q, so that there are z proper 
subsets ofV, S\,. . . ,S q ,. . . ,S Z . Define the minimum-cost assignment with respect 
to the real z-vector s = (si, . . . ,s z ) to be the minimum-cost assignment with respect 
to edge costs c,-j + J2{ q -.(i,j)es } s q- If Ak is the minimum-cost assignment with respect 
to s, define 

z 

(i,j)eA k 9=1 

Then max s >o a(s) = W. 

Theorem 3.1.3 follows from choosing the subtour elimination constraints and the 
outdegree 1 constraints for Bx > d. Theorem 3.1.4 follows from picking the subtour 



46 CHAPTER 3. THE ASYMMETRIC CASE WITH TRIANGLE INEQUALITY 

elimination constraints plus the additional redundant constraint J2i i x ij — n f° r 
Bx > d, while Theorem 3.1.5 comes from picking the indegree 1 and outdegree 1 
constraints for Bx > d. In each case, the results of Edmonds [7] guarantee that 
Bx > d has integer extreme points. 

Theorem 3.1.5 is of special interest, since some non-constructive approximation 
algorithms for the asymmetric TSP are based on the assignment problem. Several 
researchers have used the assignment problem with no edge weighting as a lower 
bound for the TSP (see [2], §2). A more sophisticated approach was developed by 
Balas and Christorides [1]. They consider the minimum-cost assignment A\ subject 
to a certain set of weights w t . They find 

L(w) = min{ ]T (c,-,- - X] w t a W + J2 Wta °} 
(i,j)eA, ter ter 

where T is a set of linear combinations of the subtour elimination constraints and 
node- degree constraints expressed in the generic form 

J2 aljiij > a l . 

l<i,j'<7i 

Although the best bound can be obtained by finding max m >o L(w), for computational 
reasons Balas and Christofides consider max wg (y L(w), where W is a particular sub- 
set of the non-negative w. The next theorem shows that their heuristic is dominated 
by the Held-Karp heuristic. 

Theorem 3.1.6 The value produced by the Balas-Christofides heuristic is no greater 
than that of the Held-Karp heuristic. 

Proof: As with Theorem 3.1.5, we apply Geoffrion's theorem by letting Bx > d 
correspond to the constraints J2j X{j = 1, i = I, . .. ,n and J2i x ij = 1> 3 — 1> • 



, n, 



and let Ax > b correspond to the constraints J2i<i j<n a lj x ij ^ a o^ £ ^- Then 
ex + A(6 — Ax) — L(X). By Edmonds' theorem, Bx > d has integer extreme points, 
so max w >o L(w) has the same value as the optimal value to the linear program 
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minimize 


/ j c ij x ij 
Ki,j<n 








subject to: 


/ , x ij 
j 


= 


1 


1 < i < n, 




% 


= 


1 


l<j<n, 




/ y a ij X ij 


> 


4 


teT, 




Ki,j<.n 










Xij 


> 


0. 





(3.5) 



Since the equations Xa<; j< n a \j x ij — a o are simply linear combinations of the 
subtour elimination constraints and the node degree constraints, the linear program 
above (3.5) must be achieving the same optimal value as the asymmetric Subtour 
LP (3.1) without the redundant constraints. Therefore, m&x w >o L(w) — W, so that 
ma,x w£ w L(w) < W. ■ 

Despite this theorem, Smith [34] finds empirically that in the asymmetric case, 
assignment problem heuristics produce better lower bounds than the subgradient op- 
timization version of the Held-Karp heuristic which uses weighted 1-arborescences, 
even when the assignment problems are unweighted. This suggests that this com- 
putational method for the Held-Karp heuristic in the asymmetric case needs some 
improvement. 

3.2 Monotonicity of Solutions 

In the asymmetric case with triangle inequality, the best known tour-constructing 
algorithm produces a tour of cost at most [log n] OVT . We will show that the Held- 
Karp heuristic for the same set of problems does at least as well, with a guarantee of 
7 = ft 1 n - \ . To prove this, we first need to show a result analagous to the monotonic- 
ity result given for the symmetric case in Section 2.2. The proof of this result is very 
similar to the proof of Theorem 2.2.4, but we include it here for completeness. We 
will use the fact that the asymmetric Subtour LP (3.1) has the same value as opti- 
mally weighted asymmetric 1-trees (via Theorem 3.1.4). Recall that a minimum-cost 
asymmetric 1-tree with respect to a and (3 is the minimum-cost asymmetric 1-tree 
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with respect to edge costs Cij — C{j + on + /3j. Then, when T k is the minimum-cost 
asymmetric 1-tree with respect to a, (3, 

n 

w ( a i P) = Yl Zi i - Y,( ai + &)> 

and by our theorem, max a ^ w(a,(3) = W. 

First, we establish some notational conventions. Oik,Uk w iH be the outdegree 
and indegree, respectively, of the zth node in the fcth asymmetric 1-tree. Then 
a ifc = Oik — 1 and 6,-fc = 7,-fc — 1. Set c/- = 12u,j)eT k c ij- The adjusted cost of a tree 
T k will be 

n n 

C k + YL^ aiCiik + & b ik) = Yl ^j ~ Yl( a i + &)• 

i=\ («,j)er* »=i 

We will let {ij} stand for some orientation of the edge (i,j) so that a sentence like 
"removing {ij} lowers the cost by cujx" means either "removing (i,j) lowers the cost 
by Cij" or "removing (j,i) lowers the cost by cy;". 

As in the symmetric case, we can express finding the optimal asymmetric 1-tree 
as a linear program. If we let T\ , . . . , T t be the enumeration of all asymmetric 1-trees, 
then finding max a ^w(«,(3) can be expressed as 



maximize w 

subject to: w < c k + J2?=i( a i a ik + Pikk), Vfc = 1, . . . ,t. 



(3.6) 



The dual of this LP is 



minimize £ fe c k y k 

subject to: Y,k a ikVk = 0, i=l,. 

£* bikVk = 0, i = 1, . 

Vk > 0. 



(3.7) 



The dual finds the convex combination of asymmetric 1-trees such that each node 
has average indegree 1 and average outdegree 1. 

Recall the definition of monotonicity. If W is the cost of the asymmetric Subtour 
LP, O C V, and Wo is the cost of the asymmetric Subtour LP on node set O, then 
the asymmetric Subtour LP is monotone if for any TSP instance and any C V, 
Wo < W. As before, we will let W denote the value of the asymmetric Subtour 
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LP, and let Wr„_i] denote the value of the asymmetric Subtour LP on the node set 
{1, . . . , n — 1}. Assuming W[„_i] > W will lead to a contradiction. 

Let T = Tfc, a — (ai, . . . ,a n _i), and /3 = (/? 1? . . . ,/3 n _i) be the optimal 1-tree 
and the optimal Lagrangean multipliers for [n — 1], respectively, so that 

n-1 

W[ n _i] = c fc + ^2(aia ik + Pibik). (3.8) 

t=i 

We first show that T and (a, /3) can be picked such that the two edges adjacent 

to node 1 have the same reduced cost. 

Lemma 3.2.1 There exist Lagrangean multipliers (a,/3) for [n — 1] for an optimally 
weighted 1-tree T such that if {l,x}, {l,z} £ T , then cs lx -> = c/ l2 ). 

Suppose that {l,a:},{l,z} 6 T, and c^ lx y < C{ l2 }. This implies that {l,a;} must 
be the single cheapest edge adjacent to 1, so all optimal 1-trees with respect to the 
Lagrangrean multipliers (a,/?) must include {l,a;}. 

Consider the dual linear program (3.7) that finds the minimum-cost convex com- 
bination of asymmetric 1-trees. By complementary slackness, each tree T k for which 
j/fc 7^ in the optimal dual solution is a minimum-cost 1-tree with respect to (a, /?) 
in the primal. As noted above, {l,:c} must be in each of these trees. Since x will 
have at least degree two for each tree (as it is in a cycle), it must have exactly degree 
two for each tree in the dual solution. In fact, it must have indegree exactly 1 and 
out degree exactly 1. 

Pick one such tree Tfc. Since x has indegree 1 and outdegree 1, increasing either 
~a x or P x will not change the adjusted cost of T/, from the optimum value, Wr 7l _ 1 i. As 
in the symmetric case, this does not affect the optimality of the spanning tree of Tj. 
on 2, . . . , n — 1. If node z is also adjacent to node 1, we increase ~a x (if {l,x} = (x, 1), 
f3 x if {l,a;} = (l,a:)) by C{ lz } — C{i x \. Then {l,a;} and {l,z} are still the two cheapest 
edges adjacent to 1, but "C{\ x } — c"{iz}- By the arguments above, T k is a minimum- 
cost 1-tree with respect to the modified multipliers (a, /?) such that T k has adjusted 
cost W[ n _!]. Thus Tk and the new (a,/3) are optimal. ■ 

We will now assume that Wr n _ 1 i > W and show that this leads to a contradiction. 
Let T(a n ,f3 n ) be the minimum-cost 1-tree on V with respect to (a,/?) for nodes in 
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[n — 1] and a n ,(3 n for node n. If the adjusted cost of T(a n ,(3 n ) is greater than or 
equal to Wr n _i] for any «„,/?„, then by supposition it is greater than W. Thus we 
have found vectors (a,/3) for which the minimum-cost 1-tree on V has adjusted cost 
greater than >V, which contradicts the maximality of W. 

Thus, T(a n ,(3 n ) must have adjusted cost less than W[ n _i]. We will show that we 
can delete node n from some T(a n ,f3 n ) such that the adjusted cost of the resulting 
1-tree is no greater, which contradicts the minimality of T with respect to (a, (3). 
Thus the supposition W < ) / Vr ri _ 1 i must be false. 

Lemma 3.2.2 There exist a n ,f3 n such that n has indegree one and outdegree one in 

T(a n ,(3 n ). 

Proof: If a n ,(5 n are sufficiently large, then the node must have either indegree one, 
outdegree zero OR indegree zero, outdegree one in any minimum-cost 1-tree. Then, 
as in the symmetric case, we can slowly reduce either a n or /?„ by S until n has 
indegree one and outdegree one. ■ 
We can now prove the theorem. 

Theorem 3.2.3 W[ n _i] < W and thus the asymmetric Subtour LP is monotone. 

Proof: Assume, as we have above, that Wr„_i] > W, and that T — Tk and a, /? are 
the optimal 1-tree and multipliers for [n — 1]. Let a n ,f3 n be such that node n has 
indegree one and outdegree one in T(o7 n ,/3 n ) = T p , and let w and x be the two nodes 
adjacent to n, with (w,n),(n,x) € T p . If (w, x) and (x,w) are not in T p , then form 
the 1-tree T q by removing edges (w,n) and (n,x), and adding (w,x). Since a np = 0, 
b np = 0, dip = dig, bi p = big, and c wx < c wn + c nx by the triangle inequality, 



c q + J2?=l ((*i a iq + P Mq) < C p + a n a np + (3 n b np + J2?=l ("t'Otp + PMp) 

< Ck + T,i=i(aia ik + f3 t b ik ), 



which contradicts the minimality of T(= T k ) on [n-1] with respect to the multipliers 

Suppose that the edge (w,x) (or (x,w)) is already in T(a n ,(3 n ). This means that 
there is a undirected cycle (n, w, a;), and since node 1 is in the unique cycle in a 
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1-tree, either w or x must be node 1. Say that w = 1. By the optimality of T(a n , /3 n ), 
{l,x} must be one of the edges adjacent to node 1 in T. By Lemma 3.2.1, there 
exists another edge {l,z} with Z{ lz y - C{ lx y. So we can remove edge {l,x} and add 
{1,2:} without affecting the optimality of T(a n ,/3 n ). {l,x} = {w,x} is no longer in 
the tree, so we can shortcut node n as above. 

This establishes the desired contradiction, so it must be the case that W[ n _i] < 
W. * 

The best-known tour-constructing approximation algorithm has a guarantee of 
a = [log n\ OVT and is due to Frieze, Galbiati, and Maffioli [11]. Their algorithm in- 
volves iterating the assignment problem. The assignment problem yields a collection 
of subtours on the nodes. A representative node from each subtour is selected, and 
the process is iterated. When all remaining nodes are in one subtour, the subtours 
represented by the remaining nodes are patched in. Since the number of nodes is 
at least halved on every iteration, at most [logn] iterations are needed. Further- 
more, each assignment problem is a lower bound on the cost of the tour; i.e., if 
Ai,...,Aao sn -] are the costs of the [logn] assignment problems, then Ai < OVT 
for 1 < i < [log n\ . Also, since the combination of the assignments yields a directed 
Eulerian graph which can be shortcut to a tour, X^f"" 1 A > OVT. It follows that 
this method yields a tour no longer than [log n] OVT. 

The cost of each assignment problem can be bounded in terms of W. 

Lemma 3.2.4 Let Ai be the cost on an assignment problem on some subset of nodes 
Si C V. Then Ai < W. 

Proof. Let x be an optimal solution to the asymmetric Subtour LP on the nodes 
- Si C V. By the theorem above, Wo < W. By Theorem 3.1.5, for assignments 
on Si, max s >ofl(s) = Wo- The minimum-cost assignment on 5,- has cost Ai = a(0), 
so Ai < W. ■ 

Thus 



[logn] 

OVT < J2 A < 
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Chapter 4 

The 1,2-TSP 



The 1,2-TSP is a special subcase of the symmetric TSP in which either c i3 = 1 or 
Cij = 2 for all i,j. Notice it follows that the 1,2-TSP obeys the triangle inequality. 
Even with this restriction, the 1,2-TSP is AfV- complete; in fact, it was this version 
of the TSP that was shown to be jVP-complete in Karp's groundbreaking paper on 
the MV- completeness of certain combinatorial problems [22]. 

The strong limitation on edge costs gives the 1,2-TSP some unusual properties. 
For instance, any tour whatsoever will have cost no more than twice the cost of the 
optimal tour, for the simple reason that a tour will have to cost at least n, but no 
tour can have cost more than 2n. We prove another unusual property of the 1,2-TSP 
below. 

Theorem 4.0.5 Let OVT be the cost of the optimal tour for a 1,2-TSP instance, 
and let BIC be the cost of the minimum-cost biconnected graph. Then OVT — ETC. 

Proof: Since a tour is a biconnected graph, certainly BIC < OVT. To prove 
the opposite direction, we will consider the ear-decomposition of the minimum-cost 
biconnected graph. An ear-decomposition is a partition of the edges of a graph into 
"ears", or paths in the graph. The paths are either simple paths (no repeated nodes) 
or simple cycles (only the end-nodes of the path are repeated; "interior" nodes are 
not repeated). An ear decomposition is a sequence of ears such that each edge of the 
graph is uniquely contained in some ear, the end-nodes of an ear appear in previous 
ears in the sequence, but interior nodes of an ear are not contained in any previous 
ear. We will use the following theorem. 

53 
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Theorem 4.0.6 (Whitney [38]) An undirected graph is biconnected if and only if 
it has an ear decomposition whose first ear is a cycle. 

Let Ei,...,E k be the ear decomposition of the minimum-cost biconnected graph. 
We will show inductively that there is a tour through the nodes of the ears E\, ...,E{ 
which cost no more than the edges in E\,...,E{. Then for i - k, we will have a 
tour that costs no more than the costs of the edges in the decomposition; in other 
words, OVT < BIC. The base case is trivial, since E\ is a simple cycle. Suppose 
the inductive hypothesis holds for i. Let T,- be the tour constructed from E\, ...,£,-. 
If Ei+i is an edge, the hypothesis holds for i + 1 trivially. If E i+1 is a cycle, it must 
have one node in common with T;: call it p. Let (p,u) be an edge from T,- and let 
(p,f) be an edge from Ei+\. Then T,- + i can be constructed from T, and E{ + i by 
removing (p,u) and (p,/), and adding (u,f). By the triangle inequality, T,-+i will 
have cost no greater than that of T; plus that of Ei+\. Now suppose that J5,-+i is 
a path. It meets T t - at exactly two nodes: call them p and q. There must be edges 
(p,f) in E i+1 (/ ^ q) and (q,u) in T{. We can construct a tour T i+1 from T; and 
E{+i by deleting (p, /) and (g,u), and adding («,/). This changes the cost of Ti plus 
-^t'+i by c u / — c p f — c gu which can be at most 2—1 — 1 = 0. ■ 

Recall our conjecture at the end of Section 2.2 that the lower bound of the Held- 
Karp heuristic is the same as the lower bound for the minimum-cost biconnected 
graph (namely, \OVT) for the symmetric case with triangle inequality. It might 
seem reasonable to conjecture here that the Held-Karp heuristic displays the same 
sort of behavior, and is close to OVT = B1C, perhaps within an additive constant. 
The theorem below shows that this is not the case. 

Theorem 4.0.7 For all No, there exists an instance of the 1,2-TSP with n nodes, 
n > No, such that the optimal solution to the Subtour LP has cost j^OVT. 

Proof: We will demonstrate a family of instances Ik of the 1,2-TSP such that 
OPT = lOfc and the cost of the optimal solution to the Subtour LP is 9k. The 
family of instances is built up recursively from an instance I\ shown as a graph in 
Figure 4.1. Instance I± is a known example from the literature. The edges in the 
graph correspond to edges whose cost is 1; edges not present in the graph have cost 
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Figure 4.1: Instance I\ 



2. Instance I 2 is constructed by attaching a variant of I\ called Iq to nodes a\ and 
&i in Ij. See Figure 4.2; we add edges in the place of the dotted lines. Instance I 3 is 
constructed by attaching Iq to a 2 and b 2 of I2, and so forth. 

First, we will show by induction that the cost of the optimum tour for instance Ik 
is 10&. Figure 4.3 shows a tour of length 10 for I x . A tour for I k +\ can be constructed 
from a tour for Ik by removing (a,k,bk) and traversing I in a manner similar to the 
tour of I\. 

Now we need to show that there is no tour of Ik that has cost less than 10£. The 
base case is simple: by exhaustive search, I\ has no Hamiltonian cycle. Suppose that 
the inductive hypothesis holds for h but not for h+i- We will show that this forces a 
contradiction. All tours of 1,2-TSP instances have cost equal to the number of nodes 
in the graph plus the number of cost-two edges in the tour. If the hypothesis doesn't 
hold for Ik+i, then there must be fewer than k + 1 cost-two edges in the optimum 
tour for Ik+i- Divide the cost-two edges of the tour into three sets: Sk,k,So,o, an( i 
5fc o- Since 7^ +1 is constructed from an Ik instance and an Iq instance, Sk,k w iH be 
the set of cost-two edges whose endpoints are both in the Ik section of Ik+i, So,o will 
be the set of cost-two edges whose endpoints are both in the Jo section, and 5^0 will 
be the remaining cost-two edges. Clearly \Sk,k\ + |«S"o,o | + \Sk,o\ < k. 

Suppose I S^o I = 0. Then the tour must enter and leave the Iq section through 
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Figure 4.2: Instance I 2 = I\ -\- Iq 




Figure 4.3: Optimum Tour of I\ 
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edges (a k ,c) and (b k ,a k+1 ). Any Hamiltonian path in I from c to a k+1 must use a 
cost-two edge. Thus there is a Hamiltonian path entirely in I k from a k to b k with 
fewer than k cost-two edges. But then we could construct a tour of I k with cost less 
than 9k + k = 10k by adding edge (a k ,b k ) to the path, contradicting the hypothesis 
that the optimum tour of I k has cost 10&. 

Now suppose |S;t ? o| > 0. Consider the tour of I k obtained by shortcutting all 
visits to the I section. For instance, if the tour enters the I section via a cost-two 
edge (u k ,u ) and leaves it via a cost-two edge (v ,v k ), delete the path from u k to 
v k and add edge (u k ,v k ). Call this a "type I" shortcut, and note that it removes at 
least two cost-two edges from the graph and adds at most one. If the tour enters the 
Jo section through a cost-two edge (u k ,u ) and leaves it via (c,a k ) (or (a k +±,b k )), 
remove the path from u k to a k and add edge (u k ,a k ) (or (u k ,b k )). This "type II" 
shortcut removes at least one cost-two edge and adds at most one. If we perform 
any type I shortcuts, then our resulting tour of I k will have fewer than k cost-two 
edges, which contradicts the hypothesis. We can have at most two type II shortcuts, 
since the tour cannot pass through a k and b k more than one time each. Suppose the 
two type II shortcuts add two cost-two edges (u k , a k ) and (v k , b k ). We remove these 
two edges, and construct a new tour by adding (u k ,v k ) and (a k ,b k ). Then we have 
removed two cost-two edges, and only replaced one, so the new tour of I k uses fewer 
than k cost-two edges, a contradiction. 

Finally, suppose we have one type II and no type I shortcuts. If we enter via 
(u k , u ) leave via (c,a k ), notice that there is no Hamiltonian path from any u in Iq 
through all nodes in I to c. Thus the path from u Q to c must use at least one cost- 
two edge, so performing this type II shortcut removes two cost-two edges and adds 
one, which is again a contradiction. If we enter via (u k ,u ) and leave via (a k+ i,b k ), 
then there must be a cost-two edge in the tour adjacent to a k (since neither (a k ,b k ) 
nor (a k ,c) can be in the tour). Call this edge (a k ,v). If (a k ,v) = (u k ,u ), the 
shortcutting removes a cost-two edge and adds a cost-one edge (namely, (a k ,b k )). If 
not, perform the shortcut. If it adds a cost-two edge (b k ,u k ), then construct a new 
tour by removing (b k ,u k ) and (a k ,v) and adding (a k ,b k ) and (u k ,v). In either case, 
we get a tour of I k with fewer than k cost-two edges, a contradiction. 

Now we must show a Subtour LP solution for I k with cost 9k. Certainly any 
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Figure 4.4: Feasible Solution to Ii 



solution to the Subtour LP for ly. must have cost at least 9fc, since for any solution 
Yli<j x ij — n = 9^; and Cij > 1 for all i, j. Consider a generalization of the solution 
to I2 shown in Figure 4.4. It is not hard to check that this is a feasible solution of 
cost 9k (the subtour elimination constraints can be checked using the edge-shrinking 
heuristic of Crowder and Padberg. See [28], §2.1). ■ 

The best known guarantee on the Held-Karp heuristic for the 1,2-TSP is the 
7 = | bound of the symmetric case with triangle inequality. The best known tour- 
constructing heuristic for the 1,2-TSP is due to Papadimitriou and Yannakakis [30]. 
Their heuristic guarantees a tour with length no longer \QVT ' . Since | < ^, it is 
an interesting open question as to whether the Held-Karp heuristic for the 1,2-TSP 
is as good as Papadimitriou and Yannakakis's heuristic. 



Chapter 5 

Conclusions and Open 
Problems 



Through the course of this thesis, we have seen that solutions produced by the Held- 
Karp heuristic have deep connections to matroids and biconnected graphs, and also 
have nice structural properties, including planarity and monotonicity. In some cases 
we have been able to exploit this structure to find lower bounds on the worst-case 
performance of the heuristic. Since we can find no instances on which the heuristic 
does as badly as our bounds, we strongly suspect that these bounds can be improved. 
What are these better bounds? What additional structural properties will we need 
to prove these bounds? 

One of the initial motivations for exploring the structure of Held-Karp solutions 
was the heuristic's extremely good performance "on average". However, we have 
confined ourselves to considering the worst-case performance of the heuristic. Can 
anything be said about the "average" case performance of the heuristic? Goemans 
and Bertsimas [14] give a probabilistic analysis of the heuristic for instances drawn 
from 3t d under the Euclidean metric. Can more be done along these lines? 

We noted in the introduction that there are no known practical polynomial-time 
algorithms for the Held-Karp heuristic. We also pointed out in Chapter 3 that 
although in theory the Held-Karp bound for the asymmetric case should be better 
than certain assignment-problem based bounds, in practice some researchers found 
the opposite to be true. This shortfall between theory and practice may be due to use 
of the subgradient optimization algorithm, which is not guaranteed to converge to the 



59 



-M^w^iu i ro p ww^fiaw^ 



60 CBAPTSM5. CONCLUSIONS AND OPEN PROBLEMS 

optimal valve. Fartker work am tke H«id-K»rj> keariatic i hoaJ a Ma rlwt tf an attempt to 
find a practical algorithm. W* thmfc that tha a viltifki i tajajitaa i <rf the Hrid-Karp 
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